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Abstract 

We consider processes with second order long range dependence resulting from heavy 
tailed durations. We refer to this phenomenon as duration-driven long range dependence 
(DDLRD), as opposed to the more widely studied Hnear long range dependence based on 
fractional differencing of an iid process. We consider in detail two specific processes hav- 
ing DDLRD, originally presented in Taqqu and Levy (1986), and Parke (1999). For these 
processes, we obtain the limiting distribution of suitably standardized discrete Fourier trans- 
forms (DFTs) and sample autocovariances. At low frequencies, the standardized DFTs 
converge to a stable law, as do the standardized sample autocovariances at fixed lags. Finite 
collections of standardized sample autocovariances at a fixed set of lags converge to a degen- 
erate distribution. The standardized DFTs at high frequencies converge to a Gaussian law. 
Our asymptotic results are strikingly similar for the two DDLRD processes studied. We cal- 
ibrate our asymptotic results with a simulation study which also investigates the properties 
of the semiparametric log periodogram regression estimator of the memory parameter. 
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Introduction 



The renewal-reward process of Taqqu and Levy (1986) and the error duration model of Parke 
(1999) are nonlinear models with long memory. Both models embody useful features not shared 
by traditional linear long-memory models (such as ARFIMA), in that they both allow simulta- 
neously for regime switching and long memory without requiring these two commonly-observed 
phenomena to be separately parameterized. The models intrinsically possess both structural 
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change and long memory, in an inextricably intertwined manner, and thus may help practition- 
ers to view these two phenomena as a duality rather than a dichotomy. 

In the renewal-reward process, the value of the process stays constant at some random level 
throughout regimes of durations governed by a sequence of i.i.d. random variables with finite 
mean but infinite variance. In the model of Parke (1999), the process is written as a sum of 
present and past shocks, where shocks survive in the sum for durations governed by a long-tailed 
i.i.d. sequence. In both models, there is a one-to-one correspondence between the tail index of 
the i.i.d. duration sequence and the memory parameter of the process. Therefore, we will say 
that both of these models possess duration- driven long range dependence (DDLRD). 

Liu (2000) has used the renewal-reward process in a stochastic volatility model for financial 
returns exhibiting simultaneous long memory and regime switching in the volatility. The eco- 
nomic motivation for such a model is a scenario where trading is stimulated by news arrivals, 
and the duration of a volatility regime created by a given news event is heavy-tailed. Liu (2000) 
fitted a such a stochastic volatility model to the returns on the S&P 500 and found that it was 
successful at simultaneously capturing the long memory and heavy-tailed regime switching of 
volatility, and that it was successful at forecasting volatility. 

The error duration model of Parke (1999) has drawn considerable recent attention among 
practitioners in finance and economics. By focusing on the duration of shocks rather than 
on fractional differencing of the shocks, the model provides an appealing paradigm for long 
memory in economic time series and in volatility of financial series. For example, Bollerslev 
and Jubinski (1999) invoked Parke's error duration mechanism to argue that under certain 
reasonable assumptions on the duration of the impact of particular news events, the aggregate 
information arrival process will have long memory, a conclusion that supports a version of the 
Mixture of Distributions Hypothesis (MDH). Another relevant example was given by Parke 
(1999), who argued that the error duration model provides a plausible mechanism for explaining 
long memory in aggregate employment. He assumed that an error represents the effect of a 
given firm on aggregate employment and holds constant for the lifetime of the firm. He then 
analyzed survival rates for U.S. businesses, and showed that the rates were consistent with an 
error duration model that induces long memory in employment. 

As models possessing DDLRD gain increasing application, practitioners may feel that, if 
faced with data generated by a model having DDLRD, they can safely use the standard meth- 
ods of data analysis and statistical inference for long-memory series. In particular, they may 
wish to examine the sample autocovariances, or to construct the log-periodogram regression 
estimator (GPH) of the memory parameter, due to Geweke and Porter-Hudak (1983), or to use 
the Gaussian semiparametric estimator (GSE) of Kiinsch (1987). Some caution may be in order 
here, however, since most of the existing theory assumes that the series is either Gaussian (see 
Robinson 1995a and Hurvich, Deo and Brodsky 1998 for GPH), linear in an i.i.d. sequence 
(see Velasco 2000 for GPH), linear in a Martingale difference sequence (See Robinson 1995b for 
GSE, Chung 2002 for autocovariances), or, in the case of volatility, that the observations can be 
transformed into a sum of linear series (see Deo and Hurvich 2001, Hurvich and Soulier 2002, for 
GPH applied to long memory stochastic volatility models). If the Taqqu-Levy and Parke models 
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are to be widely accepted and used, it is necessary to build a theory for the currently-standard 
methodology of long-memory data analysis and inference that applies to such series. The present 
paper represents a first step in that direction. We will explore the asymptotic properties of the 
discrete Fourier transforms (DFTs) and sample autocovariances from both processes. Some of 
the results are surprising, and tend to confirm that caution was indeed warranted. 

One surprising result we find is that both the sample autocovariances at a fixed lag and 
the DFT at a fixed Fourier frequency, if suitably standardized, have limiting non-Gaussian 
stable distributions. This implies that a data analysis based on examination of the sample 
autocovariances may be misleading. It also implies that data analytic methods that rely on 
the very low frequency behavior of the DFT of a series with DDLRD will not have the same 
asymptotic properties as in the linear long- memory case. (See, e.g., Chen and Hurvich (2003 a,b) 
on fractional cointegration of linear processes). On a more positive note, but still surprisingly, 
we find for the DFT at the j'th Fourier frequency Xj = 27Tj/n where n is the sample size, that 
if j tends to oo sufficiently quickly, then the DFT is asymptotically normal. This indicates that 
the DFT at not-too-low frequencies has some robustness to the type of long-memory generating 
mechanism. It also suggests that standard estimation methods such as GPH and GSE may 
retain the same properties that they are already known to have in the linear case, although some 
trimming of very low frequencies may be needed. Our theoretical results will be augmented with 
a Monte Carlo study, both to calibrate the finite-sample applicability of our theorems, and to 
briefly explore the properties of the GPH estimator for models with DDLRD, a topic which we 
do not attempt to handle theoretically here. 

The organization of the remainder of this paper is as follows. In Section 2, we review some of 
the existing theory on second order long memory processes, so as to contrast it with the theory we 
will develop for the DDLRD processes. In Section 3, we give the precise formulation of the Taqqu- 
Levy and Parke models, exhibit their autocovariance functions, present a proposition which 
shows that Parke's process is well defined only in the stationary case, elaborate further on the 
differences between the models, and present some basic theory for the two models. In particular, 
in Section 3.4 we consider the weak convergence of partial sums for both processes, and in Section 
3.5 we consider asymptotics for the empirical process in the Taqqu-Levy case. In Section 4, we 
present the asymptotics for the discrete Fourier transforms for both series, treating the cases 
of low frequencies and high frequencies separately, as the limiting distribution is different in 
these two cases. In Section 5, we consider the asymptotics for the sample autocovariances of the 
Parke and Taqqu-Levy processes. Interestingly, the joint limiting distribution of a collection of 
standardized sample autocovariances at a fixed finite set of lags is degenerate. In Section 6 we 
present the results of a simulation study. In Section 7, we present some concluding remarks. In 
the Appendix, we present some useful lemmas, and give the proofs of our main results. 

2 Second order long memory 

We start by recalling some classical definitions and facts about long memory processes. A 
second order stationary process X = {Xt, t S Z} is usually said to be long range dependent if 
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its autocovariance function ^(t) = cov{Xq, Xt) is not absolutely summable. This definition is 
too wide to be useful. A more practical condition is that the autocovariance is regularly varying: 
there exist H £ (1/2, 1) and a function L, slowly varying function at oo, such that 

7(i) = ^(t)lf''"'. (2.1) 

A function L is slowly varying at oo if it is bounded on finite intervals and if L{at) / L[t) — > 1 
as t — > oo for all a > 0. For fractional Gaussian noise (i.e., the increments of a fractional 
Brownian motion) L{t) is a positive constant. For the ARFIMA(p, d, q) model of Granger 
and Joyeux (1980), Hosking (1981), L(t) approaches a positive constant as f — > oo. Other 
examples of functions L that are slowly varying at oo include logt, powers of logt, and iterated 
logarithms. For more details, see Resnick (1987) or Bingham, Goldie and Teugels (1989). Since 
the autocovariances of the processes considered in this paper are generated by tail probabilities 
of positive random variables, our general regular variation assumption is needed to allow our 
theory to cover cases of practical interest. 



Under condition ()2.ip . it holds that: 

lim n-2^L(n)~Var ( ) = -4r(-2ff) cos(7ri/). (2.2) 

\t=l / 

A second order stationary process satisfying (j2.2p will be referred to as a second order long 
memory process, and the coefficient H is the long memory parameter of the process, often 
referred to as the Hurst coefficient of the process X. We will henceforth use this terminology. 

A weakly stationary process with autocovariance function satisfying ()2.ip has a spectral 
density, i.e. there exists a function / such that 

7(t) = r fixy'^dx. 

The function / is the sum of the series 

which converges uniformly on the compact subsets of [— vr, vr] \ {0} and in L\[ — vr, vr], dx). It is 
then well known that the behaviour of the function / at zero is related to the rate of decay of 7. 
More precisely, if we assume in addition that L is ultimately monotone, we obtain the following 
Tauberian result: 

lim L{l/x)-^x'^^-^f{x) = Tr-^T{2H - 1) sin(^//). (2.3) 

x— >0 

(Cf. for instance Taqqu (2003), Proposition 4.1). The usual tools of statistical analysis of weakly 
stationary processes are the empirical autocovariance function, the discrete Fourier transform 
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(DFT) and the periodogram. We will focus here on the DFT and periodogram ordinates of a 
sample Xi, . . . , X„ , defined as 

n 

t=i 

for integers k, 1 < k < n/2. In the classical weakly stationary short memory case (when the 
autocovariance function is absolutely summable), it is well known that the periodogram is an 
asymptotically unbiased estimator of the spectral density. This is no longer true for second 
order long memory processes. Hurvich and Beltrao (1993) showed (assuming that L{l/x) is 
continuous at x = 0, though the extension is straightforward) that for any fixed positive integer 
/c, there exists a constant c(A;, H) > such that 

hm E[Ix,k/f{xk)]=c{k,H). 

n~too 

The previous results hold for any second order long memory process. We now describe some 
weak convergence results that are valid for Gaussian or linear processes. 

If X is a second order long memory Gaussian process, converges 
weakly to the fractional Brownian motion Bnit) which is the zero mean Gaussian process with 
covariance function given by: 

E[BHis)BHit)] = ^{\sr-\t- + \tD ■ 

Here weak convergence is in the space D of right-continuous and left-limited (cadlag) functions 
on [0, oo). 

This result can be extended to a strict sense linear process, i.e. a process X for which there 
exists a sequence {€j)j£z of i.i.d. random variables with zero mean and finite variance, and a 
square summable sequence of real numbers (aj)jgz such that for all i G Z, 

Xt = y^^ajet^j. 

jez 

If aj = L(i)|j|^-3/2, then X is a second order long memory process with Hurst coefficient 
H, and L{n)~^^'^n~^ Yl^k=i -^k converges weakly, in the sense of weak convergence of finite 
dimensional distributions, to the fractional Brownian motion B}{{t). This can be proved easily 
by applying the Central Limit Theorem for linear processes of Ibragimov and Linnick (1971, 
Theorem 18.6.4). Weak convergence in the space T> can also be proved. Cf. Gorodeckii (1977) 
or Lang and Soulier (2000). A classical example of such a long memory linear process is the 
ARFIMA(p, d, q) process, whose Hurst coefficient \s H = \/2 + d. 

For Gaussian and linear processes, a weak convergence result can also be obtained for the 
periodogram and the DFT ordinates. For any fixed j, f{xj)~^^'^dx,j converges to a complex 
Gaussian distribution with dependent real and imaginary parts. Cf. Terrin and Hurvich (1994), 
Chen and Hurvich (2003 a,b). Walker (2000), and Lahiri (2003). 
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The asymptotic behaviour described above is different from the behaviour of weakly depen- 
dent processes, such as sequences of i.i.d. or strongly mixing random variables, whose partial 
sum process, renormalised by the usual rate -y/n, converges to the standard Brownian motion. 
But these long memory processes share with weakly dependent processes the Gaussian limit and 
the fact that weak limits and L? limits have consistent normalisations, in the sense that, if ^„ 
denotes one of the statistics considered above, there exists a sequence Vn such that Vn£,n con- 
verges weakly to a non degenerate distribution and f^E[^^] converges to a positive limit (which 
is the variance of the asymptotic distribution). 

In the sequel we define two second order stationary models, which possess properties ()2.ip 
and ()2.3p . but whose weak limit behaviour is extremely different from that of Gaussian or linear 
models. In Section [3] we define these models. 



3 Formulation of the Models 
3.1 The Taqqu-Levy Model 

Let {Tfc} be i.i.d. positive integer-valued random variables with mean /i, in the domain of 
attraction of a stable distribution with tail index a G (1, 2), i.e. there exists a function L, slowly 
varying at infinity such that for all n > 1, 

lP(ri >n)= L{n)n~°'. (3.1) 

To avoid trivialities, we also assume that P(Ti = 1) > 0. Let 5o be a non-negative integer-valued 
random variable, independent of the {Tk}, with probability distribution 

P{So = u)= fi'^Pin > n + 1), n = 0, 1, . . . . (3.2) 

Let {Wk} be i.i.d. random variables with = and var[IVfc] = cr^ < oo. Assume that the 

{Wk} are independent of 5*0 and {T^.}. We observe a process denoted by {Xt} for t = 1, . . . , n. 
The observed process is constant on regimes (intervals) determined by 5*0 and the interarrival 
times T^. The constant value on each regime is given by one of the {VFfc}. The time between the 
start of the sample and the first change of regime is Sq, and the subsequent waiting times are 
Ti, . . .. The total time up to the end of the /c'th regime (A: = 0, 1, . . .) is given by S-i = —1, 
^0 and 

5fc = 5o + ri + ... + rfe, A: = l,2,.... 
The observed process {Xt} is given by Wk if t lies in the fe'th regime, so that 

CXD 

Xt = Y,Wkl{s,.,<t<s,}, (3.3) 

fc=0 

where \a is the indicator function of the set A. Let M„ be the counting process associated with 
the renewal process {5o, ^i, . . . }, i.e. a non- negative integer- valued random variable denoting 
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the total number of regime changes in the series before the time n — 1: 

Mn = k^ Sk^i <n< Sk. 

The renewal process {So, 5*1, ... } is called a stationary renewal process, in the sense that the 
counting process has stationary increments, whence the following result (Cf. Liu 2000, 
Theorem 1.1). 

Proposition 3.1. The process X defined by (|3.3|) is strictly stationary with zero mean and 
covariances 

coY{Xo,Xr) = a^F{So > r) = /i-V^E[(Ti - r)l^T,>r}]- 

If \3. 1\) holds with 1 < a < 2 and L ultimately monotone, then X is second order long memory 
with Hurst coefficient H = {3 — a)/2 and spectral density f satisfying 

limL(l/x)-ix2^-V(x) = 2n{l'-H)t, r(2^- l)sm(^^)- 



3.2 The Parke Model 



Let {et)tez be a sequence of i.i.d. random variables with zero mean and {ns)s£Z be a sequence of 
i.i.d. non-negative integer valued random variables which is independent of {et)tez- For s G Z, 
define 

gs,t = l4^s<t<s + ns. 
Parke's error duration process is then defined as: 

s<t 

Let A'^ be a generic random variable with the same distribution as the rig, and define 

Pk ■■= P(iV >k) k>0. 

{Pk)k>o is then a non-increasing sequence such that po = 1 and limfc„>ooPfc = 0. 

Parke (1999) does not discuss the existence of this process. In his main result, he assumes 
that it is well defined and second order stationary. Since the terms in the sum defining the 
process are not vanishing, by well defined we mean that the sum is almost surely finite. We now 
give a necessary and sufficient condition for the process X to be well defined. 

Proposition 3.2. Parke's process is well defined if and only i/E[iV] < oo. In that case it is 
strictly stationary. If moreover eo has variance a^, then Parke's process has mean zero, finite 
variance and covariances 

oo 

cov(Xo, X,) = (T^ = E[{N + 1 - r)l{^>,.}] = ^eY.P''- 

j>r k=r 
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If the survival probabilities pt are regularly varying with index a G (1,2), i.e. if they satisfy 

Pj=nN>j) = L{j)j-'', j>l, (3.4) 

where L is slowly varying and ultimately monotone at infinity, then Parke 's error duration model 
X exhibits second order long memory with Hurst coefficient H = (3— a)/2 and its spectral density 
f satisfies 

lim L(l/x)-ix2^-V(^) = n2H - 1) siniTTH). 



3.3 Differences between the two models 



In the error duration process, the durations are independent of birth dates which are determin- 
istic and shocks can overlap; in the renewal-reward process, the durations are exactly equal to 
the interval between two consecutive birth dates, which form a renewal process, so that there is 
only one surviving reward at any given time point, and it is precisely the value of the process. 
In both cases long memory is caused by the heavy-tailedness of the durations. This property 
implies that some of the durations are eventually extremely long, as illustrated in Figures [T] 
and [21 

Variations on these processes, which retain their main features, are possible; see Deo, Hsieh, 
Hurvich and Soulier (2006) for a detailed account. Given the econometric motivation of the 
error duration and renewal-reward processes given by Parke (1999) and Liu (2000), and since 
it would be difficult to present a completely unified presentation and proof of our results, we 
consider in this paper only these two processes. 

In Figure dl the horizontal lines represent the durations of the shocks e^. The value of 
the error duration process (the bullet) at some time point is the sum of present and past shocks. 
The shock et-2 lasts for a very long time and is still present at time t + 1, whereas the shock 
€t-i exists only over one period of time. 



• et+i — 

et-i • 



nt~-2 
h 



t-2 t-1 • t+1 



Figure 1: A path (•) of the error duration process: Xt = et„2 + ^t, ^t+i = + + 

In Figure [21 a portion of a path of the renewal-reward process is drawn; the interval Tk+i is 
very long, so that the process X is constant over a long period of time between Sk and Sk+i- 
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Tk-1 



Wk+T 



k-l 



'fc+1 



Tk 



Sk- 



Sk 



t" 



Figure 2: A path (•) of the renewal-reward process: Xt = Wk, Xti = Xtn = Wk+i- 

3.4 Asymptotics For Partial Sums 

Let X denote either Parke's or Taqqu-Levy's process. The next proposition shows that although 
the process X is second order stationary and its autocovariance function exhibits long range 
dependence, the partial sum process of X converges to a stable Levy process with independent 
increment, which implies that its behaviour mimics that of a sum of i.i.d. heavy tailed random 
variables. In the case of the Taqqu-Levy Process, it is stated without proof in Taqqu and Levy 
(1986); it can also be seen as a particular case of Theorem 2 in Mikosch et al. (2002). 

Proposition 3.3. Assume that k3.1\) and (j3.4|) hold with 1 < a < 2. Denote £{n) = n^-'^/^inf 
{t > : P({7 > t) < n~^} with U = Ti for the Taqqu-Levy process and U = N for the Parke 

process. Then the finite dimensional distributions of i{n)^^n~^^°' Ylt^=i -^k converge weakly to 
those of the a-stable Levy process Aq, with characteristic function 

]E[gmA<,(t)j =exp{-t|u|"/i^iE[|er]r(l-a)cos(7ra/2)(l -i/3sign(u)tan(7ra/2))} , (3.5) 

with f3 = (]E[^"] — E[,^"])/E[|^|°] and = W\ in the case of Taqqu-Levy's process and ^ = ei and 
fjL = 1 in the case of Parke 's process. 

3.5 Empirical process of Taqqu-Levy's process 

In the case of Taqqu-Levy's process, the invariance principle (i.e., the limit theorem for renor- 
malized partial sums) can be straightforwardly extended to an invariance principle for instan- 
taneous functions of the process: if i;^> is a measurable function such that E[(/)^(VFi)] < oo and 
E[(/>(l^i)] = 0, then the finite dimensional distributions of i{n)~^n~^/°' ^^^^^(j){Xk) converge 
weakly to those of an a-stable Levy process, where i is the same slowly varying function as in 
proposition 13.31 For Parke's process, we conjecture that this is true for polynomial functions. 
It is actually shown in the case i;^(x) = — E[ef] in Theorem 15.11 and a similar proof would 
probably work in the case of a higher order polynomial. 

In the special case of an indicator function, we obtain the usual interval-indexed empirical 
process: 

1 

k=l 
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Let Fw(x) = ¥{Wi < x) be the distribution function of Wi. Then F„ is an estimator of Fw 
and we have the following convergence result. 

Theorem 3.1. The finite dimensional distributions of the process i(n)^^n^^^^°'{Fn — Fyy) con- 
verges weakly to those of the process Aq,(F(-)), where Aq, is the stable Levy process with charac- 
teristic function 

]E[ei«A„(i)] ^ |n|"/i-ir(l - a) cos(7ra/2)(l - isign(u) tan(7ra/2))} , 

and £{n) = n^/" inf {t > : P(ri >t) <n~^}. 

4 Asymptotics for the DFTs 

Define 

n 

t=i 

where X denotes either Taqqu-Levy's or Parke's process. 

4.1 Low frequencies 

Proposition 4.1. Define dnj = ^1^^=!^ ^e^'^'^^^ with r]^ = T^Wk for the Taqqu-Levy process 
and r]k = n^ek o-nd /U = 1 for Parke's process. If ()3.ip and ()3.4p hold and if j < for some 
/9 G (0, 1 — l/a), then £{n)~^n~^/°'{Dn,j — dnj) = op{l) , where £ is defined as in Proposition [373[ 

Since in both cases 77^ belongs to the domain of attraction of an a-stable law, Proposition 
14.11 implies if j < n'', then i{n)~^n~^^°'Dnj converges to a stable distribution. The conclusion 
of Proposition 14.11 continues to hold if the upper bound is replaced by cn^, where c is a 
positive constant. In the case of fixed frequencies, we can describe more precisely the asymptotic 
distribution of the suitably normalized DFT coefficients. 

Theorem 4.1. Let ji < ■ ■ ■ < jq be q fixed positive integers. Let i be defined as in Propo- 
sition nOi Then l{n)~^n^^/°'{Dnj^, ■ ■ ■ , Dnj^) converge in law to the complex a-stable vector 

( e^"^-'^*(iAci(s), • • • , /o^ e^''^-'«*(iAci(s)^ , where Aq, is the a-stable Levy process with characteris- 
tic function given by ()3.5p . 

4.2 High frequencies 

In the high frequency case, the asymptotic behaviour of the discrete Fourier transform is the 
same as it is for linear series. 
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Theorem 4.2. If let j be a non decreasing sequence of integers such that j /n and j > 
for some p G {1 — l/a,l), then {27mf{xj))~^^'^Dnj is asymptotically complex Gaussian with 
independent real and imaginary parts, which are each zero mean Gaussian with variance 1/2. 

The conchision of Theorem 14.21 continues to hold if the lower bound is replaced by cn^, 
where c is a positive constant. 

5 Asymptotics for the Sample ACF 

The empirical autocovariance is often used as a diagnostic for long memory, hence it is of 
importance to investigate its properties in the present context. For n > 1 and fc > 0, define 
Xn = Yl=i Xk and 

n—k 

%{k) = n-' Y^^Xt - Xn){Xt+k - Xn). (5.1) 
t=i 

Since in both cases, X is a second order stationary process, 7n(^) is an asymptotically unbiased 
estimator of ^{k) = cov(Xo,Xfc). In the next proposition, we show that it is also a consistent 
estimator and obtain its rate of convergence and asymptotic distribution. 

Theorem 5.1. Assume that (|3.1|) and (|3.4|) hold, E[|eo|'^] < oo and E[|VFo|'?] < oo for some 
q > 2a. Denote = Ws{Ts — '^[Ti]} or = ^si^'s ~ E[ni]}. Let = 1 in the case of Parke's 
process. Then for any fixed k > and any slowly varying function h, 

%ik) - j{k) = - V 6 + op(/i(n)ni/"-i). (5.2) 
n ^-^ 

Define i as in Proposition^^ Then£{n)-'^n^-'^/°'{%{k)-j{k)) converges weakly to an a-stable 
random variable with characteristic function 

Ele'""^] = exp{- |'u|"mar(l - q) cos(7ra/2)(l - isign(u) tan(7ra/2))} , 

with nia = E[|eip"] in the case of Parke's process and rua = E[|M^ip"]//i in the case of the 
Taqqu-Levy process. 

Remark 5.1. The op term in (j5.2p is not uniform with respect to A;, but (j5.2p implies that for 
any fixed integers g, ki, . . . ,kq, the asymptotic distribution of the vector i{n)~^n^~^^'^[%{ki) — 
7(A;i), . . . ,jn{kq) — ^{kq)] is that of an a-stable vector whose components are equal. Thus, the 
joint limiting distribution of a finite collection of standardized sample autocovariances at fixed 
lags is degenerate. 

Remark 5.2. Since we assume that the shocks et or rewards Wk have zero mean, the process 
X itself has zero mean for both models. If it is known to the data analyst that the mean is 
zero then no mean correction is needed in the sample autocovariances. However, in practice this 
knowledge is rarely assumed, so we have presented our results for the mean corrected version. 
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Remark 5.3. The conclusions of Theorem 15.11 hold also for ^(n)~^n^~^/"(/5.„(/c) — p{k)) where 
Pn{k) and p{k) are the sample and population autocorrelations at lag k. This non-Gaussian 
limiting distribution (as well as the degeneracy described above) for the standardized sample 
autocorrelations will clearly affect the asymptotic properties of parametric method-of-moments 
estimators which are based on a finite number of sample autocorrelations. See, for example, 
Tieslau, Schmidt and Baillie (1996). 



6 Simulations 

Throughout this section, we denote the long-memory parameter hy d £ (0,0.5). Note that 
d = H — 1/2 = 1 — a/2. In all of our simulations, we use a sample size of n = 10000. We chose 
to use ARFIMA{0, d, 0) autocovariances in our simulations because they are nonnegative and 
monotone non-increasing, which is consistent with the nonnegative and non-increasing autoco- 
variances implied by both the Taqqu-Levy and Parke models. Let j{t) be the autocovariance 
sequence of an ARFIMA{0, d, 0) process, 

r(t + d)r(l - 2d) y , , 

^W = r(t-d+i)r(i-d)rw '°-' = °-^---- <"> 

where (Tq is the standard deviation of the ARFIMA innovations. For the integer- valued inter- 
arrival time So as well as the {T^} in the Taqqu-Levy process and the survival times {ug} in 
the Parke process, we use the following simulation algorithm : Let X denote either Sq, or Ug 
and let G{x) = P{X > x). We can simulate an observation x of X by drawing an observation 
u oi a uniform random variable and setting x to be the integer such that 

G{x)>u> G{x + l). (6.2) 

In all cases we consider here, G{x) is expressed in terms of the Gamma function, so that there 
is an easily evaluated continuous increasing function G{x) which is equal to G{x) for all integer 
values at which G{x) is defined. The solution to (j6.2p can be written as 

x=[G~\u)\, (6.3) 

where \x\ denotes the greatest integer less than x. We obtain the solution x to (j6.3p using a 
simple bisection algorithm (see, eg, Johnson and Riess 1977 page 115). 



6.1 Simulation of Taqqu-Levy Process 

Before describing our sampling algorithm, we provide some convenient formulas for P{Sq > t) 
and P{Tk > t). From (j3.2p and Proposition 13. H we have 
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and 



7(0) 

Thus, for t > 1, we have: 



P{So>t) = ^, t = 0,1,2,... (6.4) 



PiTk >t)= fiP{S^ 







P{So = t-l) 



P{So = 0) 
> t - 1) - F(5o > t) _ 7(t - 1) - 7(^) 
nSo>0)-F{So>l) 7(0) -7(1) ' 



(6.5) 



For all of our simulations of the Taqqu-Levy process, we assume that iTq = 1. From (j6.4p and 
(jG.Sp . we can sample Sq and {T^} using the bisection algorithm. We also simulate iid normal 
random variables Wk with mean zero and variance = 7(0), independent of Sq and {T^}. 
The duration of the 0th regime is 5*0 and the duration of the kth. regime is for fc > 1. The 
value of the series Xt is constant at throughout the feth regime. This yields the simulated 
realization Xq, . . . ,Xn~i- Occasionally, the entire simulated realization was constant, as there 
were no breaks before n — 1. Such realizations were discarded. 



6.2 Simulation of Parke's Process 

By Proposition 13.21 Parke's process is well defined if and only if with probability one, for all t, 
there is a finite number of shocks surviving at time t. This allows us to simulate a process which 
is distributionally equivalent to Parke's using only a finite sum 

t 

Xt= Yl 9s,tes, t = 1,2,... (6.6) 

S = -J 

where — J is the time index of the oldest shock that survives at time t = 0. The non-negative 
integer- valued random variable J has a probability distribution 

00 

p{j<j)= n (^-p^)- (6.7) 

k=j+l 

In order to obtain the covariances (|6.ip . for < d < 1/2, the survival probabilities are defined 
by (see Parke, 1999) 

r{2-d) T{k + d) , „ . „ f... 

For each realization of Parke's process, we start by sampling J from the probability distribution 
determined by (j6.7p truncated to the range (0, 1,2,..., 10000). This was adequate for the values 
of d considered here, d = 0.1 and d = 0.4, since the sum of the probabilities up to that truncation 
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point is extremely close to one in both cases. Next, we generate a sequence of standard normal 
shocks J • The innovation variance cJq of the ARFIMA{0, d, 0) process is related to o"^ 

(we have cj^ = 1) by 

^ r(i- d)r(2 -d) 

° r(2-2d) ' ^ ' 

Next we discuss the simulation of the {ra^} sequence. Special attention must be paid to the 
survival time n_j for the oldest shock e_j. It is not sampled from the probability distribution 
determined by {p^}, but rather from the conditional distribution 

P{N >i\N>J) = —, i> J. (6.10) 
Pj 

We apply the bisection algorithm to sample n_j and the other {ns}1^_j_^i from (j6.8p and (|6.10p . 
Using the values {ns}~}^_j^ we compute the "death time" for each prehistoric shock {csjj^.j . 
At each time t > 0, there may be some past shocks dying, so the time series Xt is generated by 
adding a new shock to the previous value Xt-i and subtracting the sum of those shocks dying 
at time t. 



6.3 Simulation Results 



We performed Monte Carlo simulations to assess the finite sample properties of the DFT co- 
efficients in light of Theorems 14.11 and 14.21 for both the Taqqu-Levy and Parke processes. We 
generated 500 replications of length n = 10000 in each case. Recall that d = 1 — ^a, and 
1 < a < 2. We used autocovariances corresponding to an ARFIMA{0, d, 0) model as described 
earlier, with d = 0.1 and d = 0.4. For each value of d, the normalized Fourier coefficients 
were evaluated at frequency xj with j = 1,2, [n°-^J, [n^'-^J, [n'^-^J, [n^'-^J, [|J — 2, [|J — 1. For 
the Taqqu-Levy process with d = 0.4, there were 60 constant realizations. We excluded these 
constant realizations from our analysis, while keeping the number of realizations used at 500. 

Figures [3][1] present the normal Quantile-Quantile (QQ) plots of the normalized Fourier cosine 
coefficients Aj/f{xj)2 for the Parke process with d = 0.1 and d = 0.4, where 

^ n— 1 

^ (27rn)V2 E cos(x,t). (6.11) 

The number inside the parenthesis at the bottom of each QQ plot represents the p-value for 
the Anderson-Darling test of normality. According to Theorems 14.11 and 14. 2^ if j increases 
sufficiently quickly with the sample size n, i.e. when j > nP for p > 1 — 1/a, the normalized 
Fourier coefficients are asymptotically normal. Furthermore, as d increases, the value of a will 
decrease, and the condition on the rate of increase of j to ensure asymptotic normality becomes 
less stringent. When d = 0.1, we have 1 — 1/a = 0.4444, a number larger than 1 — 1/a = 0.1667 
when d = 0.4. For the Parke process with d = 0.1, we do not reject the hypothesis of normality 
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for j > n^'^; while d = 0.4, we reject the hypothesis of normahty for j < n?'"^. Thus our 
simulation results are essentially consistent with the results of Theorems 14.11 and 14.21 We found 
similar results for the Taqqu-Levy process. Since the results for the normalized Fourier sine 
coefficient 

^ n—l 

are very similar to those we found here, we do not present them here. 

Figure O presents scatterplots of the average log normalized periodogram vs. log |2 sin(a;j/2)| 
at the Fourier frequencies from j = 1, . . . ,4999. We would expect a horizontal line across all 
frequencies if E log is constant for all j. The plots indicate that at low Fourier frequencies, 

the average log normalized periodogram is changing but approaches a constant as j increases. 
If I{xj)/ f{xj) were distributed as (l/2)x| as would be the case for a Gaussian white noise 
process, we would have E [I{xj)/ f{xj)] = —7 = —0.577216 in FigureO There seems to be some 
evidence that the log normalized periodogram is biased upward for the Taqqu-Levy process 
with d = 0.4, but not for the other situations considered. Note that since the DFT coefficients 
converge weakly to an a stable law at fixed low Fourier frequencies, we should expect higher 
variability of the log normalized periodogram at these frequencies. This suggests that if we 
regress {log(/(xj))} on {log(/(xj))} without trimming a set of low Fourier frequencies, we may 
get a biased and/or highly variable GPH estimator. Further evidence is given in Figure [U which 
presents scatterplots of the average of log{I{xj)) vs. log2| sin(xj/2)| together with their fitted 
least-squares lines. We also found that there are several outliers at low frequencies for both 
processes with d = 0.1 as well as d = 0.4. However, there are more outliers in the case of 
d = 0.1 for both processes. The fact that the normalized periodogram behaves differently at the 
low Fourier frequencies may present a problem for the GPH estimator if we include all Fourier 
frequencies. The presence of the low outliers found above is not surprising since under DDLRD, 
for fixed j, I{xj)/ f{xj) = Op{l) for fixed j under DDLRD. See Comment 3 in Section 7. 

Figure [7] presents normal QQ plots for the sample autocorrelations based on the Taqqu-Levy 
process with d = 0.1. The Anderson-Darling values are extremely small so we reject the null 
hypothesis of normality in all cases. Furthermore, the plots indicate long-tailed distributions. 
These findings do not contradict Theorem 15.11 which states that the autocovariances for both 
processes will converge to an a-stable law. We found similar results for the Taqqu-Levy process 
with d = 0.4 as well as the Parke process for both values of d. 

Tables [1] and [2] present simulation variances of the normalized DFT cosine coefficients and 
the corresponding normal-based 95% confidence intervals for the true variance, <t^. We do not 
reject the null hypothesis that o"^ = 0.5 for any j when d = 0.1 in the Taqqu-Levy process, but 
when d = 0.4, we reject the null hypothesis for j = n/2 — 1. For the Parke process, we accept 
the null hypothesis for all Fourier frequencies with both values of d except for j = nP'"^ in the 
case d = 0.1. Thus the results are essentially consistent with the theoretical variances stated in 
Theorem 14.21 
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Concluding remarks; topics for future research 



1. The main theoretical results we have obtained for the Parke and Taqqu-Levy models 
are strikingly similar. Also, it seems clear that the class of processes having DDLRD is 
much larger than the two processes we have considered in this paper. A specific example 
of another such process is the random coefficient autoregression studied in Leipus and 
Surgailis (2002). We have so far been unable to find an overarching unification for DDLRD 
processes which would allow the development of a single set of theoretical results that 
applies to the entire class, although such a unification seems desirable, and may well be 
possible. 

2. In Robinson (1995a), the theory of a modified GPH estimator was developed for Gaussian 
long-memory processes. One aspect of the modification was that an increasing number of 
low frequencies were trimmed (omitted) before constructing the estimate. Subsequently 
Hurvich, Deo and Brodsky (1998), who also assumed Gaussianity, showed that trimming 
can be avoided. More recently, Hurvich, Moulines and Soulier (2002) showed that trimming 
can also be avoided in a different log-periodogram regression estimator, assuming a linear, 
potentially non-Gaussian series. For linear series, it is known that the DFT at fixed j is 
asymptotically normal (Terrin and Hurvich, 1994), but that the periodogram is asymptot- 
ically neither independent, identically distributed, nor exponentially distributed (Kiinsch 
1986, Hurvich and Beltrao 1993). Simulations, mostly from Gaussian long-memory series, 
indicate that trimming yields a very modest bias reduction, while inflating the variance 
of the GPH estimator substantially. (See also Deo and Hurvich 2001, in the context of 
LMSV models). 

In contrast, the results of the present paper indicate that if the long memory is generated 
by DDLRD, then trimming of low frequencies may in fact be desirable. The DFT at fixed 
j converges in distribution to an infinite-variance stable distribution, but (under a different 
normalization; see Comment 3 below) if j is allowed to increase suitably quickly a limiting 
normal distribution results. It is unclear at this moment whether trimming is needed 
to establish the asymptotic normality of the GPH estimator based on a process having 
DDLRD, but clearly the failure to trim low frequencies may adversely affect the finite- 
sample behavior of the GPH estimator. Paradoxically, the larger d is, the less stringent 
the conditions on the rate of increase of j to ensure asymptotic normality. This seems 
to indicate that when d is larger less trimming would be needed, both in theory and in 
practice. This runs counter to the effects studied by Hurvich and Beltrao (1993) (which 
concern only the second order structure of the process) which imply that the bias of the 
normalized periodogram increases as d increases from zero. 

In any case, it should be stressed that we have not attempted to derive in this paper any 
asymptotic properties for the GPH estimator or any other estimator of the long memory 
parameter under DDLRD. We leave this as a topic for future research. 

3. There is as yet no reliable way to distinguish between linear long memory and DDLRD 
on the basis of an observed data set. Some of our theoretical results may ultimately prove 
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helpful in this regard, but we leave this as a topic for future research. We note here that the 
low- frequency periodogram ordinates, normalized by the spectral density, are asymptoti- 
cally normal under linear long memory models, but converge in probability to zero under 
DDLRD. This latter result follows since from our Proposition 14. H we obtain after a short 
calculation that for fixed j, I{xj)/ f{xj) = Op(2/a + a — 3), so that I{xj)/ f{xj) = Op{l). It 
also follows from Proposition 14. II that in the DDLRD case under a different normalization, 
the periodogram I{xj) is asymptotically stable if j is fixed. 

4. It is known (see Chung 2002 and the references therein) that for a long-memory process 
linear in martingale differences, the autocovariances are asymptotically normal if d < 1/4, 
but converge to a non-normal, finite-variance distribution if d G (1/4, 1/2). So the asymp- 
totics for the sample autocovariances depend on d, which is an undesirable property from 
the point of view of statistical inference. Davis and Mikosch (1998) have shown that for 
short-memory ARCH and GARCH models, the asymptotic properties of the sample auto- 
correlations are more severe, as there is no convergence in distribution. Now, for DDLRD, 
the behavior is somewhere in between the linear long memory and ARCH/GARCH cases, 
since for DDLRD the sample autocorrelations do converge in distribution for all d with 
< d < 1/2, but the limiting distribution has infinite variance, and depends on d. Thus, 
the properties of parametric estimators of d which use a fixed number of sample autoco- 
variances will be strongly affected by the presence of DDLRD. 
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Figure 3: QQ Plots of the Normalized Fourier Cosine Coefficients Aj / f{ujj)^ for Parke process; 
n=10000, d=0.1 
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Figure 4: QQ Plots of the Normalized Fourier Cosine Coefficients Aj/f{uj)2 for Parke process; 
n=10000, d=0.4 
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Figure 5: Scatterplots of Average Log Normalized Periodogram vs. log|2sin(a;j 
j=l,2,...,4999 . Horizontal line represents —7 = —0.577216 . 
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Figure 6: Scatterplots of Average Log Periodogram vs. log |2 sin(a::j/2)|; j=l,2,...,4999 
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;ure 7: Normal QQ Plots of Sample Autocorrelations for Taqqu-Levy Process, d- 
lag 2 lag 20 lag 40 
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Table 1: Simulation variances for normalized DFT cosine coefficients at frequency Xj for Taqqu- 
Levy Process, with normal-based 95% Confidence Intervals, a = 0.05. Intervals marked with * 
reject the null hypothesis, o"^ = 0.5 . 



d 


Xj Variance 


Confidence Interval 


0.1 


n"-^ 0.54 
nO-^ 0.54 
0.49 
0.53 

f-2 0.51 
f - 1 0.50 


0.48 0.62 
0.47 0.61 
0.44 0.56 
0.47 0.60 
0.45 0.58 
0.44 0.56 


0.4 


n^-^ 0.56 
nO-^ 0.55 
0.52 

n°-s 0.55 
f-2 0.55 
f - 1 0.58 


0.49 0.63 
0.49 0.62 
0.46 0.59 
0.49 0.63 
0.48 0.62 
0.51 0.66* 



Table 2: Simulation variances for normalized DFT cosine coefficients at frequency Xj for Parke 
Process, with normal-based 95% Confidence Intervals, a = 0.05. Intervals marked with * reject 
the null hypothesis, o"^ = 0.5 . 



d 


Xj Variance 


Confidence Interval 


0.1 


n"-^ 0.66 
n°-^ 0.54 
n°-6 0.46 
n°-s 0.51 
f-2 0.49 
f - 1 0.46 


0.58 0.75* 
0.48 0.61 
0.41 0.53 
0.45 0.58 
0.44 0.56 
0.41 0.53 


0.4 


n"-^ 0.47 
nO-^ 0.49 
n°-6 0.46 
n°-8 0.47 
f-2 0.54 
f - 1 0.52 


0.42 0.54 
0.44 0.56 
0.41 0.53 
0.42 0.53 
0.48 0.62 
0.46 0.59 
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APPENDIX 



A Lemmas 

We present some lemmas in this section. Most of these are presumably known, but we were 
unable to find references for them under the conditions we needed for our main results. We 
therefore include proofs for the sake of completeness. 

Lemma A.l. Let (Cfc)fcGN* be a martingale difference sequence such that si\pj^^iE,[\(^k\^] < oo 
for all p < a. Then, for any slowly varying function h, 

M„ [n/fj] 
k=l k=l 

Proof. To simplify the notation, without loss of generality, we can assume that fi = 1. For all 
m, denote Sm = Yl^=i Cfc- By Theorem 2.5.15 in Embrechts et al. (1997), there exists a slowly 
varying function £ such that ^(n)~^n~^/"(M„ — n) converges in distribution to a stable law. 
Thus, for any sequence 5„ tending to infinity, we have: 

lim P {\Mn -n\> 5n(.{n)n^/°'\ = 0. (A.l) 

n— >oo V / 

Let e > and 5n be an arbitrary sequence tending to infinity. For any slowly varying function 
/i, we can write: 

>en^/"/i(n)) 

< P(|M„ - n| > (^„n^/"£(n)) + P (|M„ - n\ < 5nn^'"i{n)- |5m„ - 5„| > eni/"/i(n)) 

< P(|M„ -n\> ,5nn^/"£(n)) + P ( max |S„ - Sm\ > en^/"/i(n) ) . 

\m:\in—n 

Fix some p G (l,a) and denote Cp = sup;j>;^ E[|<^fc|P] < oo by assumption. Denote By Kol- 
mogorov's and Burkholder's inequalities (cf. Hall and Heyde (1980), Theorems 2.1 and 2.10), 
we obtain: 

P( max \Sn - > en^/"/i(n)) 

m:\m—n\<n5„'n^^°'i{n) 

< cCpe-in"^/"/i(?i)-^((5„?i^/"^(n))i/P. 
Since p > 1, this last term is o(l) is the sequence 5n converges to infinity slowly enough. □ 
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Lemma A. 2. Let {Cn,k)i<k<n be uniformly bounded random variables. Let {Tk)k>i be i.i.d. 
random variables that satisfy (j3.4p for some a G (1,2) and such that for all n > 1 and all 
k < n, Tf; is independent of 1 !^ i < k}. Let be i.i.d. random variables with zero mean 
and finite variance, independent of Cn,k, 1 < k < n and Tk, 1 < k < n. Let H be a bounded 
continuous function such that for all u £M and v G (0, 1); 

\H{u, v)-u\< C\u\{u^v^ A 1 + v^}. (A.2) 

Ifm < cn andj < for some p G (0, 1/a), thenJ2'^^^Cn,kWk{H{Tk,Xn,j)-Tk} = op{n^^"i{n)) 
for any slowly varying function i. 



Proof. Define = Yllt=iin,k{H{jTk/n) — jTk/n}Wk and let 'Kt,c denote the conditional ex- 
pectation with respect to all the variables Cn,fc ^-nd T^. Since the variables Cn,fc a-re uniformly 
bounded, and since, for p G [l,a), the function x — > x^^^ is concave, we obtain: 

{n ^ P/2 n 

Y,{H{Tk,Xn,j) <CY, \H{Tk, Xn,j) - Tk\P. 

k=l ) k=l 

Hence, taking expectations on both sides and applying (|A.2p . we obtain: 

n 

E[ic„n < cY,n\H{Tk,xn,j)-Tk\n 

k=l 

< CnE[|Ti|P(|jTi/n|2 A If] + Cn{j/nfP < CnL{n){{3 /n^-P + {j/nfP}. 

Thus, in = Op{{nL{n)Y/P{j''/P-^ + {j/nf]). If p < 1 - 1/a, then p can be chosen such that 
{nL{n)^^/P{j°'/P~^ + (j/'H')^} = o{n^^"l{n)). Hence ^„ = op(?i^/"£(?i)) for any slowly varying 
function i. □ 

Lemma A. 3. Let (k be a sequence of i.i.d. rv such that for allp G (1, a), E.[\(k\P] < oo, E[Cfc] = 
and Qk is independent of Sq, Ti, . . . , Tk-i- Let K be a bounded continuously differentiate function 
on M, with bounded derivative. Define Um,n,j = YlT=i ^i'Sk-iXn,j)Ck and Vm,n,j = YlT=i 
l)fiXn,j)Ck- If m < cn and j < for some p G (0, 1 — 1/p, then Um,n,j — ^m,n,j = op(n^/"£(?i)) 
for any slowly varying function I. 



Proof. Denote i2fc = Ti + • • • + — kp. Since K is differentiable, we can write: 

m 

^m.,n - Vm,n = ^ K' {{k - l)/iX„j + <^k{Sk~l - {k - 1) fJ,Xn,j){Sk^i - {k - l)/x}x„jCfc 
k=l 

n n 
i,j ^ Pn,kRk-lCk + SQXnj ^ Pn,kCk, 



k=l k=l 



where Pn^k = I^'{{{k—^)p+<ik{Sk-i — {k—l)p}/n). Since E[|^fc|] < oo and is bounded, the last 
term above is trivially Op{l). By assumption, {X]j=i Pn,fc-Rfc-iCfc) 1 < < n} is a martingale 
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with finite p-th. moment for p < a. Hence by the Burkholder inequality for martingales, we 
have, for p < a, E[\Rk\P] = 0{k) and 



E 



Pn,kRk-lCk 



k=l 



<C^E[|i?fc_in =0(n2 



k=l 



Thus Xn,jYlli=i Pn,kRk-iC,k ~ Op{jn'^^'^ If p < 1 — l/o, then p can be chosen so that 
jn^/p-^ = o(n^/°^(n)) for any slowly varying function □ 

Lemma A. 4. Let H he a hounded continuously differentiahle function on M such that H{x) = 
O(x^) in a neighhorhood of 0. If Ti satisfies (j3.4p . then 



POO 

lim t''L-^{t)E[H(Ti/t)] = a / H{s)s-''-^ds. 



Proof. Assume first that H has a compact support in (0, oo) and is continuously differentiable. 
Then: 



k=l 

fOO 



E[H{Ti/t)] = H{k/t)F{T = yfc) = ^ H{k/t){F{T >k)-F{T>k- 1)} 

k=l k=l 

= S2F{T>k){H{k/t)-H{{k-l)/t)}= / F{T > [s\] + l)H'{s/t)ds/t 

{[s\ + l)~"L([sJ + l)H'{s/t) ds/t = / {\tx\ + l)-"L([txJ + dx, 

JO 

Since L is slowly varying, by Karamata's Theorem, we know that lim^^oo L{t)~^ L{\tx\ +!) = !, 
uniformly with respect to x in compact sets of (0, oo). Thus, since we have assumed that H has 
compact support in (0,oo), we obtain 



lim t°'L-\t)'K[H{Ti/t)] 

t— >oo 



To conclude, it is sufficient to prove that 



x-'^H'ix) dx = a x-'^-^Hix) dx. 



hm limsupi"L-^(t)E[i/(r/t)l{r>At or T<t/A}] = 0. 



(A.3) 



This tightness property allows then to truncate the function H and apply the first part of the 
proof. For any ^ > and t large enough, applying the assumption on the behaviour of the 
function H at zero, we have: 

t/A t/A 

E[HiT/t)l{r<t/A}] = Y.H{k/t)¥{T = k) < Ct^^Y.^'^nT = k). 



k=l 



k=l 
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Applying summation by parts and Karamata's theorem, we obtain: 

tjA t/A 

k^¥{T = A;) = 1 + ^ P(T > n){k^ - {k - if} < CA"-'^L{At). 

k=l k=l 

Thus, there exists a constant C such that: 

limsupt"L-^(t)E[ii'(r/t)lrr<t/A>] < C^"-2 lim L{At)/L{t) = CA""-^. 



Similarly, we can show that 



limsupt"L-^(i)E[F(r/t)l{r>At}] < CA-"" < CA" 



i— >oo 



This proves ()A.3P and concludes the proof of Lemma IA.4[ □ 

Lemma A. 5. Let j = j{n) be a sequence of integers such that < j < for < (3 < p < 1. 
Then 



lim n ^ cos(xj5fc) = P — lim n ^y^sm{xjSk) = 0, (A. 4) 

k=l k=l 

n n 

lim Vcos^(x,-5fc) =P- lim V sin^fx^Sfc) = 1/2. (A.5) 



n— >oo ^— ' n^oo 

k=l k=l 



where P — lim denotes convergence in probability. 

Note that (jA.SP follows from ()A.4[) by the relation cos^(n) = (l + cos(2u))/2 and by replacing 
3 by 2j. 

To prove Lemma I A. 51 we use the following theorem, which adapts Theorem 2 in Yong (1971). 

Theorem A.l. Let T be a non negative integer valued random variable in the domain of attrac- 
tion of an a-stable law with a S (1, 2), such that P(T > k) = k~°^L{k), where L is slowly varying 
at infinity. Let (j) be the characteristic function ofT. Then, for z > 0, (j){z) = 1 — z°'li{z)+\i2{z)z 
where ii and I2 o'^e slowly varying at zero, positive in a neighborhood of zero and satisfy, for 
some finite nonzero constant C{a), 

lim ^l{x)/L{l/x) = C{a) and lim (.2{x) = E[r] > 0. 

x^O a;— >0 

We will use Theorem lA. 1 1 through the following bound for the modulus of the characteristic 
function of T: 

|</.(z)|2 < l-2^(z)z", (A.6) 

where i{z) = (■i{z) — ^^fz"' — ^£2{z)z'^~'^ is slowly varying and positive in a neighborhood of 
zero. 
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Proof of Lemma \A.5[ We prove that the convergence holds in L^. Write 



E 



i^cos(xjS'fc) 



k=l 



n k—1 



E 



k=l 



— '^E[cos'^{xjSk)] + — ^ ^E[cos(3;j5^) cos{xjSk)] 

^ k=l ^ k=2 1=1 

n k—1 

0{n-^) + ^Y.Y1 ncos{xj{Si + Sk)) + cos(x,(5fc - S,))], 

k=2 l=\ 
^ n k~\ 

0(n~^) + — ^^E[cos(xj(S'fc -5*^)) -cos(xj(5fc ^ Si))\. 



k=2 1=1 



Thus we have to show that 



n k—1 



i^oo n ^ — ' ^ — ' 

fc=2 1=1 
^ n k—1 

1™ — y^y^E[cos(xj(5, + 5fc))] =0. 



(A.7) 
(A.8) 



k=2 e=i 

Proof of 7| j. Applying (IA.6p . for large enough n, we have 

n fc— 1 , n fc— 1 



n-1 



n 



n 



k=2k'=l k=2k'=l k=l 

For z G (0, 1) and any real number i > 1, (1 — 2;)=e*'°s{i~^) < e~*^ and 
1 " 1 " 1 p-"z/2 1 p- 



nz/2 



n 



k=l 



k=l 



n 



(e^/2 _ 1) - nz/2 



Hence: 



n k—1 



E E ]E[cos(xj(5fc - Sk'))] 



k=2 k'=l 



n-1 



J J ni{xj)xf 



(A.9) 



fc=i 



Under the assumption on the sequence j, linin^oon'i{xj)x'j = oo. Thus the limit of the last 
term in (|A.9p is 0. This concludes the proof of ()A.7p . 

Proof of IIA.8\) . Since Sk + 5*^/ = 25o + 2(Ti + • • • + Tk') + Tk'+i + • • • + Tk, and denoting cpo the 
characteristic function of Sq, we have 



n k—1 



n k—1 



E E ^ [cos(x,-(Sfc + Sk'))] < ^ E E l</'o(2x,)||0(2x,)|'=V(x, 



k=2 k'=l 



k=2k'=l 
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Applying ()A.6p . for large enough n, we obtain: 

n fc— 1 , n k—l 



k=2k'=l 



fc=2fc'=l 



Since for any slowly varying function L and any a > the function z'^L{z) is ultimately non 
decreasing, we obtain, for n large enough: 

n k~l ^ n 

E E IE[cos(x,(5fc + 5,0] < - E{1 - 2^(^.>i 

A;=2 fc'=l fc=2 

The same line of reasoning as previously concludes the proof of (jA.SP and of Lemma IA.5I □ 



B Proof of the main results 



Proof of Proposition \3.SX A necessary and sufficient condition for this process to be well defined 
is that almost surely, for all t G Z, 

inf{s G Z, s + > t} > — oo. 

Since the random variables Us are i.i.d. with the same distribution as N , by Borel-Cantelli's 
Lemma this condition is equivalent to 



E ^('^^ ^ * - = E >k)<oo. 



s<t 



fc=0 



Hence the necessary and sufficient condition for Parke's error duration process to be well de- 
fined is E[A^] < oo. The expression of the autocovariance function is proved in Parke (1999) 
Proposition 1. □ 

Proof of Proposition \3.S\ in the case of Parke 's process. For any real numbers x, y, denote x^ = 
max(x,0), X- = max(— x,0), xM y = max(a;,y) and x Ay = min(x,y). Recall that gs^t = 1 if 
s < t < s + rig and otherwise. Hence, we can write: 

n n {s+ns)+An 

E = E E 3s,kf^s = E E 3s,kes 

k=l k=l s<k s<n fc=lVs 

n 

= ^{{s + ns)+ A n}es + ^{{s + n^) A n - s + Ije^ = C/„ + Vn- 



s<0 



s=l 



Since X]s<o'^(* + > 0) = J2k>o^(^ > k) = K[N] < oo, the number of terms in the sum 
U = X^s<o('S + ns)+es is almost surely finite. Hence Un converges almost surely to U and 
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Un = Op{l). We now split Vn into three terms: Vn = Vi^„ — V2,n + V3,n, with 

n n 

Vi,n = ^{ns + l)e^, V2,n = ^{ns + l)l{,+„^>„}es, 

s=l s=l 
n 

and V3,„ = ^(n - s + l)l{s+„^>„}e5. 



s=l 



Since the sequences (n^) and (eg) are i.i.d. and independent of each other, Vs.n has the 
same distribution as Wn = Yl^=i^^{nh>k}^k- Since YlT=i^i''^k > k) < oo, by Borel-CanteUi's 
Lemma, almost surely there exists an integer K such that for all k > K, rii^ < k. Hence Wn 
converges almost surely to YlT=i k^{nk>k}^k, which is almost surely a finite sum. This implies 

that V3,n = Op{l). 

Similarly, V2,n has the same distribution as Yl^=i ^k^{rn:>k}^k, which converges almost surely 
to the almost surely finite sum X^^Li ?^fcl{n^:>fc}fA;• Hence V2,n = Op{l). 

Under assumption (j3.4p . N is in the domain of attraction of an a-stable law. Since 
by Breiman's (1965) theorem, (jig + l)es is an i.i.d. sequence in the domain of attraction of an 
a-stable law. Thus we obtain that n-^/°'£{n)-^Vi, n converges weakly to the stable distribution 
with characteristic function given by (jS.Sp (cf. for instance Embrechts et al. (1997), Proposition 
2.2.13). The convergence of finite dimensional distribution is obtained similarly. □ 

Sketch of Proof of Theorem \3.1[ Neglecting the first and last renewal periods, write 

Mn 



ini-i/°{F„(x) - Fw{x)} = £{nr'n~^/^ ^ i{w,<x}iTk - m) 

k=l 

+ /x£(n)-in"^/" Yl {Mw,<x} - Fw{x)} + (^£(n)-in-i/"M„ - l)Fwix) + op(1). 



k=l 



By Lemma lA.l) the finite dimensional distributions of i{n)n ^^"^ J2k~i'^{Wk<x}{Tk — ^) are 

asymptotically equivalent to those of i{n)n~^^°^ Yl2=i '^{Wk<x}{'Fk — m) which converge to those 
of Aa{F{x)). Since the variables Wk are independent of M„, we have, by the renewal theorem. 



E 



\k=l 



Fw{x){l - Fw{x)}nMn] =0{n). 



Thus, Zk=i {hw,<x} - Fw{x)} = op(^(n)?iV«). □ 
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Proof of Proposition \4-l\ in the case of Parke 's process. 

n n 



t=l t=l s<t 

{s+ns)+An n (s+ns)An 

s<0 t=l s=l t=s 

As in the proof of Proposition 13.31 the sum defining Unj is almost surely finite. If j'/n — > 0, 
then Unj converges almost surely to the random variable U = J2s<o('^ + ns)+es- Split now Vnj 
into three terms: Vnj = Wnj — Rn,j + Tnj, with 

n / (s+Us) \ 

= E E (B.i) 

s=l \ t=s J 

n (s+Us) 

s=l t=s 
n n 



s=l t=s 

Consider first Since the sequences (ris) and (e^) are i.i.d. and independent of each other, 
we have: 

" . l_ei("s+l)^J (d) -J^ -n -,^ I - Q^i'^k + l>] 
r> _ \ ^isxj ^ ^ -I ^ W \ ^ i(k-l)xi ^ -I 

^n,i-2^e — jn^iJ- l{s+n,s>n}es - 2^e — ^ _ gix, l{n,fe>fe}efc, 

s=l fc=l 

where = denotes equality of laws. Since almost surely there is only a finite number of indices k 
such that rifc > A;, if j /n — > 0, this last sum converges almost surely to YlV=ii''^k + l)l{nfc>fc}£fc- 
Hence Rnj = Op(l). Similarly, T^j has the same distribution as 

n n n k—1 

^ ^ e'*'''l{nfe>fc}efc = EE^~''"''^{"fc>'=}^'=• 
fc=l^=n-fc+l fc=lsi=0 

If j'/n 0, this last term converges to X^^Li ^l{nfc>A;}£fc) which is an almost surely finite sum, 
whence T^j = Op(l). In conclusion, as long as j/n 0, Wnj is the leading term in the 
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decomposition of Dnj- Consider now Wnj- It can be written as 

1 — e'^J ^ sm{xj/2) 



=1 s=l 

n 



y"^i.x, sin((re, + l)xj/2) ^ y-^isx, /gm,Xj/2 _ sin((?i, + l)xj/2) 



sin(xj/2) ^ ^ ' sin(xj/2) 

I y-,i.x, / sin(K + l)x,/2) _ \ 
i sin(x,/2) V 



y-gi.x, /gin,x,/2 _ sin((n, + l)xj/2) 
^ V ; sin(x,/2) 



To deal with the remainder terms, we use the following bounds: there exists a constant C such 
that for ah li G M and for all v £ (0, 1), 



sin (to) 



sin(t;) 



|e'"-l| <C(|'u| Al) 

< C|u|(|to| a 1) + \u\v'^ 



For p E (1,0;), applying these bounds and the moment bound for independent zero mean random 
variables with finite p-th moment (cf. Petrov (1995), addendum 2.6.20), we have: 

n 

E[|r„jf ] < (:7^E[(n,)f((n,jyn) A 1)^] = CnE[N'P{{Nj /n) A If] + Cn{j /nfPE[NP]. 

s=l 

Let us compute K[NP{{Nj/n) A 1)-^] for any p > 1. 

n/j oo 

E[NP{{Nj/n) A 1)P] = {j/nY^k^P¥{N = k) + ^^^i^ = k) < C{j /nf~PL{n). 

k=l k=n/j 

Hence, for any p G (l,a), E[|r„j|] = 0{L{n)n^+^^~°'^/Pj°'/P-'^). If j < nP for some p G (0, 1 - 
1/a), then p can be chosen close enough to a so that liuin^ao h{n)n~^^°^'E[\rnj\] = 0, for any 
slowly varying function h. □ 



Proof of Proposition \4-l\ in the case of Taqqu-Levy 's process. For clarity, we denote in this proof 
Xnj = 2TTj/n. By summing over each regime separately, we can express Dnj as 

So — 1 Mn Sfe-l n 

^n,, = M^o5^e**""'^+^T^fc ^ e''^-.^ +Wm„+i Y1 

t=0 k = l t=Sk-l t=SMn 



ri,n,j + WM„,n,j + r2,n,. 



J' 



32 



where we have defined: 

r2,n,j = ejip{i{SM„ + (n - 5'a/„)/2}x„j} 



sin({n - + l}3:nj/2) 
sm(x„j/2) 



fc=l t=Sfe_i k=l Sm[Xn,j/Z) 

Obviously, |?^i,nj| < |Wo|5'o, hence ri^nj = Op(l)) uniformly with respect to j < n/2. To deal 
with r2^n,j, note that n — is the forward recurrence time of the stationary renewal process 
(5'n.)n>0) hence its marginal distribution is constant and is equal to that of Sq (cf. Resnick (1992), 
Theorem 3.9.1). Thus, for g < a - 1, E[|r2,„j|«] < E[| Wo|'']IE[5'^] < oo. r2,„j is also Op(l), 
uniformly with respect to j < n/2. Applying Lemma [A. 11 we obtain that WM„,n,j — 'W[n/fj],n,j = 
op{n~^^°'h{n), uniformly with respect to the sequence j and for any slowly varying function h. 

We now prove that h{n)n^^/"{w[„/^-^^n,j ~ dnj) = op(l). Define Wm,n,j = ^^-^ e'('^'=-i~^/^)^"'-' 
TfcWfc. Applying LemmalAjwith m = [n/^], H{u,v) =6^™/^^^}^^ and Cn,fc = e''^^k-i-i/2)x^,j ^ 
we obtain: 

W[n/^l\,n,j - W[n/^,\,n,j = op{n^/'^h{n)). (B.2) 
Define Wm,nj = ET=ie'^^''~^''^~^^^^""-'TkWk. Applying LemmaQwith (k = TkWk, K{u) = 

W[n/^lln,j - W[n/^,],n,j = O p [n^ ^ h{n)) . (B.3) 
Finally, we bound W[n/^],n,j - dn,j- 

[n/^l] 

^[n/^A,n, - dn,j = Yl (e'^^^"- e"'(^+i/2)-".^ - e^'=-[n/Ml..)C, 

k=l 

[n/^t] [n/fj] 
= ^ gifc^i^nj (■g-i(/i+l/2)x„j _ j-)^^ _j_ ^ ^gifc/ia;„,j- _ gi^saJin/^j.j^^^^ 

k=l k=l 

Since l/[n/jj] — l/{n/fi) = 0{n~^) and j < with p < 1 — 1/a, we obtain: 

H\w[n/t^],n,j - dn,j\] < Cj/u = o(n^/°/i(n)), 
for any slowly varying function h. □ 

Proof of Theorem \4-^ in the case of Parke 's process. As seen in the proof of Proposition HTH the 
main term in the decomposition of Dnj is Wnj, defined in (jB.ip . To prove convergence to a 
complex Gaussian law, we use the Wold device. For a, 6 G M, denote 

sin((ns + l)xj/2)es 



^nA"-: = {acos((s + ns/2)xj) + 6sin((s + ns/2)xj)}- 



sin(xj/2) 
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Then Er=i?n,s(a,&) = aRe{Wn,j) + blm{Wn,j). Denote al{a,b) = E''s=iHCls{a,b)]. To prove 
that ^(o, &) '^n,s(o, 6) is asymptotically Gaussian, it suffices to prove that 



5^E[|e„,,(a,6)r] = oK(a,5)), 



(B.4) 



s=l 



for some q > 2. We first find an equivalent for cr^(a, 6). To simplify the notation, without loss 
of generality, assume = 1. We have 

sm'^{xj/2)E[^lj = E[{acos((s + n^/2)xj) + 6sin((s + ns/2)xj)}'^ sin2((n^ + l)xj/2)] 

= a^E[cos^((s + ns/2)xj) sin^((n^ + 'i-)xj/2)] + a6E[sin((2s + ns)xj) sin^((ns + l)xj/2)] 
+ 6^E[sin2((s + ns/2)xj) sin^Hris + l)xj/2)] 

+ a6E[sin((2s + ns)xj) sin2((ns + l)a;j/2)] 
a2 + 62 



+ 



2 

2-62 



E[sin^((n, + l)a;j/2)] 



2 

a2-62 



cos(2sa;j) + a6sin(2sxj) j E[cos(nsXj) sin2((ns + l)xj/2)] 
sin(2sxj) — a6cos(2sxj) > E[sin(nsXj) sin2((ns + l)xj/2)]. 



Applying Lemma lA.41 we obtain that 

l-OO 

lim x""L(l/2;,)-^E[/i(n^x,)sin2((n^ + l)2;,/2)] = a / sin2(t/2)t-"-^(it, 
with either h{t) = cos(i), h{t) = sin(t) or h{t) = 1. Now, since j — > oo, we have: 



1 " 
n ^ 



< 



2iXi _ 



n e 



oir') = 0(1). 



Thus, 



(B.5) 



lim n-ix2-"L(l/x,-)-^^E[e2_,(a,6)] 



.8 = 1 



poo roo 

2a(a2 + 62) / sin2(t/2)t-"-idt = (a^ + ^2) / sin(t)t-" 
Jo Jo 



dt 



sm(TTH). 



Hence, applying (j2.3p . we obtain: 



lim (27rn/(x,))-^5^E[e^,,(a,6)] 



a2 + 62 
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Hence cr^(a, b) ~ cnf{xj) oo. Moreover, for any q > 2, we have: 

mn,sn < C{\a\ + Ibiyxj'Eil sm((n, + l)x,/2)r] = 0(xpL(l/x,-)), 

n 

Since we have assumed that j S> n^~^^" and 5 > 2, we obtain that nx" — > 00 and ^"=1 

= o(a^(a, 6)) and dEl]) holds. □ 

Proof of Theorem \4.2\ in the case of Taqqu-Levy's process. Start by noting that if j ^ n^^^^", 
then limn^oo{nf{xn,j))~^^'^n^^'^ = 0. Hence, as in the proof of Proposition 14.11 we obtain that 
(27rn)"^/2/(x„j)"^/2(L'„j - W[n/,,],n,j) = op{l). We now prove that W[n/ii],n,j is asymptoticahy 
complex Gaussian by the Wold device. Here again, without loss of generality, we assume a'^^^ = 1. 
For arbitrary real numbers a and b, define = 27rn sin^(x„j/2)/(a;„j) and 

Vn,k = v:^^{acos{{Sk-^i + (Tfc - l)/2)xn,j) + 6sin((S'fc_i + (T^ - l)/2)x.„j)} sin(TfcX„j/2)Wfc 
= u;;;^ cos(5fc_ix„j){acos((r/,. - l)/2)x„j) + 6sin((rfc - l)/2)xnj)}sm{TkXnj/2)Wk 
+ w;;;^ sin(5fc_ix„j){-asin((Tfc - l)/2)x„j) +6cos((rfc - l)/2)xn,j)} sm{TkXn,j/2)Wk. 

Then {2Tm)-^/^ f^^^^{xn,j) {aRe(w[„/^]^„j) + 6Im(w[„/^]^„j)} = Htli ^n,k- Denote 

Bi{u) = {acos(n/2) + 6sin(n/2)} sin(n/2), 
B2{u) = {bcos{u/2) — a sin(n/2)} sin(n/2), 

fin,k = {cOs{Sk~lXn,j)Bi{TkXn,j) + Sm.{Sk-~lXn,j)B2{TkXn,j)} Wk, 

and Wm,n,j = Ylk=i'nn,k- Then 

[n/fi] 

'nn,k - Vn,k = Op(/(x„j)"^/^) = Op(l). 

k=l 

Define Mj = Yl,i=i^n,k, 1 < J < [n/^A and T = {Tk)k>i with Tk = f^{Tj,Wj,j < k). Then 
{Mj} is an J^-martingale and M.[n/fi] = 'W^[n//i],n,j- Hence, to prove that tZ'[n/^],n,j is asymptoti- 
cally Gaussian, we must prove the conditional Lindeberg conditions: 

there exists cr^ > such that ^['nn,k I ^k-i] — ^ f'"^; (B-6) 

fc=i 

[n//i] 

andVe>0, nvlkh\v^.,\>e} \ ^Fk^i] ^ 0. (B.7) 

A;=l 
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To prove (IRBI) . note that 

Hfll,k I ^k-l] =V~'^{cOs'^{Sk^iXn,j)E[Bl{TiXn,j)] 

+ Sm{2Sk-lXn,j)E[Bi{TiXn,j)B2{TiXnj)] + Sm'^{Sk-lXn,j)E[B2{TiXn,j)]}cr^Y. 

Applying Lemmas IA.4I and IA.5I and using similar computations as in the proof of the previous 
case, we obtain: 

n€,k I ■ (B.8) 

k=l 

To prove (|B.7p . since E[|W^'^|] < oo for some g > 2, it is sufficient to prove that: 

[n/ti] 

^ E[|r?„,fcr] = oK). (B.9) 
fc=i 

SinceE[|r?„,fc|''] < 2i-V^\\Bi{TkXn,jW+\B2{nxn,jm and E[|5,(rfcX„,,)l'^] = 0{xljf{xnj)), 
i = 1,2, we obtain: 

muM'] = Oinv-'^xljixn,)) = 0{vi~'^l^) = 0(1). 

fc=i 

Hence ()B.9P holds. Thus we have shown that {2TTnf{xn,j}~^^'^Dnj is asymptotically equivalent 
to {2Trnf{xnj}~^^'^W[n/^],n,j which converges weakly to a standard complex normal law. □ 

Proof of Theorem \5.1[ Define Xn,k = '^"^ Z]j=i ^'^id ^n,k = Sj=fc+i ^i- Proposi- 
tion [331 = Op{£{n)n^^"~^), and obviously, it also holds that Xn,k = Op{£{n)n^/°'~^) and 
Xn,k = Op{i{n)n^/''-^). Thus, 

n—k 

ln{k) = n ^ ^ XjXjj^k — X-nXn^k — -^n-^n,fc + {X-nf 
n—k 

= n-' Y ^J^J+k + Op(^'(n)n2/"-2). 

Thus it is sufficient to prove (j5.2p for the autocovariances without mean correction. From now 
on, we denote 7n(fc) = X]j=i -^j-^j+k and we pursue the proof in each case separately. □ 
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Proof of Theorem \5.1\ in the case of Taqqu-Levy's process. 

n—k oo n—k 

t=l j,j'=0 t=l 

oo n—k oo n—k 

j=0 t=l jy^j'=0 t=l 

= ln{k) +r„. 

Consider first r„. Note that the sums in j and j' are limited to n since by definition, Mt < t. If 
/ < j or j' > fc, the event {Mt = j; M^+fc = j'} is empty. Hence: 

4 oo j+k n—k 

j=0 j'=j+ls,i=l 
4 oo j+k n—k 

= 5E E EW = ,;Mm=/) 
i=o j'=j+i t=i 

4 oo J+fc 

+ 5E E E iP(^4 = ^t =i;M.+fc = Mt+fc = /) 

j=0 j'=j+l l<s<t<n-fc 

For s < t and j < j', the set {M^ = Mt = j; M^+fc = Mt+k = j'} is empty s + k < t. Hence: 

4 n— 

nrl] = ^Y^{Mt<Mt+k) 

4 n— fc— 1 

+ 5 E E IP(M, = Mi < M,+fc = M^+fc) = 

s=l s+l<t<s+fc-l 

Thus rn{k) = Op{n~^^^). Consider now ^nik). By definition of the renewal process, Mt = 
Mt+k = 3 if and only if Sj-i <t<Sj and Tj > k. Thus 

^ Mn-k n — k ^ Mn-k 

Uk) = - E E 1{M.=M.,.=.} = - E ^'(^^- - k)MT,>k}. 

j=l i=l i=l 

Define 7n(A;) = ^ Wj{Tj — A;)l|7-^.>fc}. By Lemma KH for any slowly varying func- 

tion h, we have that 7n(^) — 7n(^) = op(n^~^/"/i(?i)). Note now that by definition, ]E[(ri — 
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k)l{T,>k}] = t^nSo > k). Thus: 

[(n-fc)//.] 



[(n-fc)^] 

= - E ^^'{(Ti-/c)l{r^.>,}-E[(Ti-/c)l{r,>,}]} 

+ - '"V "{H^^ - a^} + 7(^){/^^^^^^^ - 1} 

n ^-^ ■' n 

[(n-fc)^] 

= - E W,2{(?;-^)l{T,>fc}-lE[(Ti-A:)l{r^>,}]} + Op(n-V2) 



[(n-fc)^] 

- E W/{r,-E[ri]} + 0p(n-i/2). 



n 



Thus we conclude that for any slowly varying function /i, 



%{k) - j{k) = -Y^ Wf{T, - Em + op{n'/'^-'hin)). 

The rest of the proof is straightforward, given the other proofs in this paper, and is omitted to 
save space. □ 

Proof of Theorem I5.il in the case of Parke 's process. 

n~k n—k 

7n(A;) = n'-^ ^ ^ ^ gs,t9s',t+kf^s(^s' = n-"^ ^ ^ l{sVl<t<{s+ns-fc)A{n-fc)}es 
i=l s<t s'<t+k s<n-k t=l 

n~k 

+ n ^ ^ ^ l{sVl<i<(s+n.s)A(n-fc)}l{(s'-fc)Vl<i<(s'+n^,-fc)An}eses' 

s<.n — k\s' <.n t=\ 

s^s' 



%{k) + rn{k). 
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We first consider rn{k). It is split into four terms as follows. 

rn{k)=n^^ ^ {{s + ns)+ ^{s' + ns' -k)+ ^{n-k)}eses' 

s<0:s'<k 

n 

+ [{{s + n^)+ A (s' + n^' - k) A {n - k)} - s' + k + lle^e^' 

s<0 s'=k+l 
n—k 

+ n^^YY^ [{(s + Us) A (s' + Us' - k)+ A (n - A;)} -s + l]ese^/ 

S = l s'<fc 

+ n~^ ^ [(s + n^) A (s' + n^/ - /c) A (n - /c) - s V (s' - A;)]eses' 

l<s<n-fc;fc + l<s'<n 

= + r2,n + rs^n + '^4,n- 

By the usual Borel Cantelli argument, nri^„ converges to the almost surely finite sum ^s<o;t<o 

s^i+k 

{{s + ns)-i. A{t + nt+k)+}^set+k- Hence ri^n = Op(n~^). By independence of the i.i.d. sequences 
(es) and {us), the terms r2^n and r^^n have the same distribution. We consider for instance the 
former. Let S be the set of nonpositive integers s such that s + ng > 0. Then S is almost surely 
finite. Write r2,„ = ^ses^n,s(^s, with 

n—k 

Cn,s = ^^[{(^ + '^^)+ + "*+^-) A (n - A;)} - t + l]et+fc 
t=i 

For each s G 5, we have: 

S+Us 

lim = [{(s + n^) A (t + ni+fc)} -t + l]et+k 

t=l 

Since S is almost surely finite, we thus obtain that 

lim nr2,n = [{(s + "-s) A (t + nt+k)} - t + l]et+fc, almost surely. 

s&S t=l 

Hence r2,n = Op{n~^) and similarly r3^„ = Op{n^^). Consider now the last term r^^n- 

HrlJ=atn-^ ^ E[{(s + n,) A (t + nt+fc) A (n - A:) - s V t}^]. (B.IO) 

l<s<n-k;l<t<n-k 
SJ^t+k 

This last expectation is finite, since the term inside is at most Ug A and if A^' is an 

independent copy of A^, then N A N' is square integrable. Indeed, we have 

F{N AN' >k)= F{N > kf = L^{k)k-'^°'. (B.U) 
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Since L is slowly varying, then so is L^, and since a G (1,2), then (jB.lip implies that NAN' is 
square integrable. Let us now compute the expectation in the rhs of (jB.lOp . Assume s < t < 
n — k. 

E[{(s + N) A{t + N') A{n- k) - sV t}^] 

n—k—s n—k—t 

j=t-s j'=0 
n-k-s j—t+s 

= E E fm=j)m'=3') 

j=t-s j'=0 
n—k—s n—k—t 

Plugging this bound into (|B.10p . we obtain: 

0{L{n)n'^~'^°') if a G (1,3/2], with L slowly varying; 
O(n-i) if a G (3/2,2). 

In conclusion, we have shown that r„(A:) = Op(n^~"). Consider now ^n{k). Still by Borel 
Cantelli arguments, we have 

%{k) = n-^ ^{{s + ns- k)+ A (n - A;)}e^ 

s<0 
n—k 



,^2l 



+ n ^ + ns-k)A{n-k)-s + l}l|„^>fc|e^ 

s=l 

1 ^(j^^ -k + l)l{„,>fc}e2 + Op(n-i). 



s=l 

n—k 

= n 

s=l 

Altogether, we have 

n—k 

%{k) - 7(A;) = ^(n, -k + l)l{„^>fc|e2 - 7(A;) + Op{n^ 



s=l 

n—k 

^{{n's-k + l)l{„^>fc} - E[{ns -k + l)l^ns>k}]} 
s=l 

^ E[(jV-l + fc)V>fc|] !^\ 2 
n ^ 

s=l 

n— A; 

1 J] {(n, - A: + l)l{„,>fc} - E[(n, - A: + 1)1{„,>,}]} + Op(n-V2) ^ 

s=l 
n 



n 

s=l 
n 

— 1 " 

n 

s=l 
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Thus, if E[|eo|'^] < cxd for some q > 2a, then i{n) ^n^ ^/"(7„(A;) — ^{k)) converges weakly to an 
a-stable distribution. □ 
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